Skip to content

test: consistent bit_size for truncate#4597

Closed
sirasistant wants to merge 1 commit intomasterfrom
arv/consistent_truncate
Closed

test: consistent bit_size for truncate#4597
sirasistant wants to merge 1 commit intomasterfrom
arv/consistent_truncate

Conversation

@sirasistant
Copy link
Contributor

@sirasistant sirasistant commented Feb 14, 2024

Please read contributing guidelines and remove this line.

@AztecBot
Copy link
Collaborator

AztecBot commented Feb 14, 2024 •
edited
Loading

Benchmark results

No metrics with a significant change found.

Detailed results

All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.

This benchmark source data is available in JSON format on S3 here.

Values are compared against data from master at commit 382626cd and shown if the difference exceeds 1%.

L2 block published to L1

Each column represents the number of txs on an L2 block published to L1.

Metric 8 txs 32 txs 128 txs
l1_rollup_calldata_size_in_bytes 45,956 181,604 724,196
l1_rollup_calldata_gas 227,228 888,404 3,535,796
l1_rollup_execution_gas 320,419 1,006,852 3,756,174
l2_block_processing_time_in_ms 1,186 (-1%) 4,751 (+6%) 17,741
note_successful_decrypting_time_in_ms 309 (-4%) 999 (+1%) 3,644 (-1%)
note_trial_decrypting_time_in_ms 21.8 (-32%) 134 (+12%) 176 (+3%)
l2_block_building_time_in_ms 18,193 (-1%) 72,091 289,881
l2_block_rollup_simulation_time_in_ms 13,504 53,448 215,462
l2_block_public_tx_process_time_in_ms 4,661 (-1%) 18,566 (-1%) 74,166

L2 chain processing

Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric 5 blocks 10 blocks
node_history_sync_time_in_ms 15,489 (+1%) 28,831 (-6%)
note_history_successful_decrypting_time_in_ms 2,414 (-3%) 4,746 (-4%)
note_history_trial_decrypting_time_in_ms 94.0 (-5%) 222 (-2%)
node_database_size_in_bytes 17,272,912 33,214,544
pxe_database_size_in_bytes 29,923 59,478

Circuits stats

Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit circuit_simulation_time_in_ms circuit_input_size_in_bytes circuit_output_size_in_bytes
private-kernel-init 329 44,528 25,313
private-kernel-ordering 196 43,633 16,193
base-rollup 1,460 129,774 933
root-rollup 82.6 (-3%) 4,192 729
private-kernel-inner 437 70,819 25,313
public-kernel-private-input 242 33,663 26,945
public-kernel-non-first-iteration 239 33,705 26,945
merge-rollup 7.81 (-2%) 2,712 933

Tree insertion stats

The duration to insert a fixed batch of leaves into each tree type.

Metric 1 leaves 2 leaves 8 leaves 16 leaves 32 leaves 128 leaves 64 leaves 512 leaves 1024 leaves 2048 leaves 8192 leaves
batch_insert_into_append_only_tree_16_depth_ms 10.3 (-1%) 10.8 (-10%) 12.7 17.1 25.3 (+10%) 64.3 N/A N/A N/A N/A N/A
batch_insert_into_append_only_tree_16_depth_hash_count 16.9 17.5 23.0 31.6 47.0 143 N/A N/A N/A N/A N/A
batch_insert_into_append_only_tree_16_depth_hash_ms 0.595 0.602 (-7%) 0.541 0.528 0.530 (+10%) 0.443 (+1%) N/A N/A N/A N/A N/A
batch_insert_into_append_only_tree_32_depth_ms N/A N/A N/A N/A N/A 74.6 47.8 239 459 (-2%) 898 3,571 (+1%)
batch_insert_into_append_only_tree_32_depth_hash_count N/A N/A N/A N/A N/A 159 96.0 543 1,055 2,079 8,223
batch_insert_into_append_only_tree_32_depth_hash_ms N/A N/A N/A N/A N/A 0.461 0.490 (+1%) 0.437 0.430 (-2%) 0.428 0.429 (+1%)
batch_insert_into_indexed_tree_20_depth_ms N/A N/A N/A N/A N/A 105 56.9 351 685 (-2%) 1,363 5,436
batch_insert_into_indexed_tree_20_depth_hash_count N/A N/A N/A N/A N/A 197 104 691 1,363 2,707 10,771
batch_insert_into_indexed_tree_20_depth_hash_ms N/A N/A N/A N/A N/A 0.497 0.496 0.475 0.471 (-2%) 0.472 0.471
batch_insert_into_indexed_tree_40_depth_ms N/A N/A N/A 56.9 N/A N/A N/A N/A N/A N/A N/A
batch_insert_into_indexed_tree_40_depth_hash_count N/A N/A N/A 94.1 N/A N/A N/A N/A N/A N/A N/A
batch_insert_into_indexed_tree_40_depth_hash_ms N/A N/A N/A 0.577 N/A N/A N/A N/A N/A N/A N/A

Miscellaneous

Transaction sizes based on how many contracts are deployed in the tx.

Metric 0 deployed contracts 1 deployed contracts
tx_size_in_bytes 16,859 35,537

Transaction processing duration by data writes.

Metric 0 new commitments 1 new commitments
tx_pxe_processing_time_ms 549 (-2%) 1,442
Metric 0 public data writes 1 public data writes
tx_sequencer_processing_time_ms 0.496 (-9%) 577

@sirasistant sirasistant changed the title testing: consistent bit_size for truncate test: consistent bit_size for truncate Feb 14, 2024
@sirasistant sirasistant force-pushed the arv/consistent_truncate branch from c8e91e0 to 8f2df2c Compare February 14, 2024 14:26
@sirasistant sirasistant mentioned this pull request Feb 14, 2024
Merged
5 tasks
@ludamad ludamad deleted the arv/consistent_truncate branch August 22, 2024 15:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@sirasistant @AztecBot